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ABSTRACT 

The general purpose of this study vas to survey and 
analyze the self study and visiting coaaittee aspects of selected 
North Central Association (NCA) secondary school evaluations to 
deteraine their effectiveness in teras of evaluation of the piocedure 
used in selecting and coaprising these coaaittees and their 
activities. The study is presented in three parts and the results are 
reported in tabular and narrative fora. Part I is concerned vith the 
self study aspect of the evaluative procedure. It reports 
effectiveness in teras of evaluation of the selection, coaposition, 
and activities of the steering and vork coaaittees in NCA 
evaluations. The tables and discussion in this part, as in reaaining 
parts, are on the total response of adainistrators and teachers froa 
all responding schools first, followed by a breakdown of response by 
size of school, and finally by the separate responses of 
adainistrators and teachers. Part II is concerned vith the visiting 
coaaittee aspect of NCA evaluation. Part III is a suaaary of the 
results. (Author/BJG) 
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An Analysis of Self Study and Visiting Committee Aspects of Selected 
NCA Secondary School Evaluations to determine Least and Most Effective Procedures. 

/ 

Introduction and Purpose of Study 

In recent years the methodology of evaluation has received considerable 
attention. This has been due primarily to the upsurge of accountability 
in the educational enterprise as well as to the sincere desire on the part of 
educators to improve the quality of education for youth. One of the leaders 
in the field has been the North Central Association of Colleges and Schools 
(NCA) through its Commission on Schools. In 1965 it initiated a program 
of evaluation for its member schools in the nineteen states that it serves. 
The program caught the attention of the education profession and its general 
format for evaluation has been adopted by many state agencies who are mandated 
to evaluate schools for accreditation and recognition purposes. 

The thrust of the NCA evaluation program i? th-t it provides its member 
schools with a viable technique for the assessment and improvement of their 
instructional programs. However, the use that individual schools make of 
it is ultimately dependent upon their particular desire to enhance and improye 
their instructional programs for students. To this end the internal 
processes of the evaluation become paramount. They combine to make an 
evaluation useful or not depending upon the choices made in establishing and 
activating the program of evaluation. 

The present state of knowledge with regard to the internal procedures 
of evaluation is limited. Recommendations are made to schools about to 
undergo evaluation on such things as setting up self study committees and 
selecting visiting committee members but little has been done in any systematic 
way to determine if these procedures are effective in bringing about a goo4 
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evaluation or, in fact, if there are better ways for doing so. Therefore, 
the general purpose of this study was to survey and analyze the self study 
and visiting committee aspects of selected NCA secondary school evaluations 
to determine their effectiveness in terms of evaluation of the procedures 
used in selecting and comprizing these committees and their activities. 
More specifically: 

1. What procedures in the selection and composition of the steering committee 
in the self study aspect of an NCA evaluation are least and most 
effective in terms of evaluation and to what extent are they used? 

2. What procedures in the selection and composition of the work committees 
in the self study aspect of an NCA evaluation are least and most 
effective in terms of evaluation and to what extent are they used. 

3. What activities of the self study committees in an NCA evaluation are 
least and most effective in terms of evaluation and to what extent are 
they used. 

4. What procedures in the selection and composition of the visiting committee 
in an NCA evaluation are least and most effective in terms of evaluation 
and to what extent are they used? 

5. What activities of the visiting committee in an NCA evaluation are least 
and mc... effective in terms of evaluation and to what extent are they used? 

Methodology 

To carry out the purpose of this study the administrators and faculties 
(i.e. steering committee members) of those Illinois schools in NCA Districts 
6 and 7 who had undergone an NCA evaluation within the last three years were 
surveyed. These individuals, having been intimately involved with the internal 
processes of evaluation and having the advantage of perspective, would be the 
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most valid and reliable sources of information available with regard to the 
effectiveness of those processes. To this end an instrument was constructed 
(see appendix) and mailed to twenty-four schools ranging in size from 124 to 
3,159 pupils. A total of eighty three questionnaires from eighteen schools were 
returned, twenty-one from administrators and sixty- two from the steering 
connittee members in these schools. The breakdown of returns by size of school 
was: eight returns (below 200), twenty- three returns (300-600), twenty-one 
returns (750-1,000), eighteen returns (K500 to 2,000), and thirteen returns 
(over 2,000). Additionally, twelve administrators were interviewed in nine 
schools which had recently undergone evaluation to secure additional 
information concerning the effectiveness of procedures in NCA evaluations. 

The results of this study are reported in tabular and nar»-ative form 
in three parts. Part I is concerned with the self study aspect of the 
evaluative procedure. It reports effectiveness in terms of evaluation of the 
selection, composition, and activities of the steering and work committees 
in NCA evaluations. The tables and discussion in this part, as in all 
remaining parts, are on the total response of administrators and teachers 
from all responding schools first, followed by a breakdown of response by 
size of school, and finally by the separate responses of administrators and 
teachers. Part II is concerned with the visiting committee aspect of NCA 
evaluation. It reports effectiveness in terms of evaluation of the selection, 
composition, and activities of visiting committees. The tables and discussion 
in Part II are organized and presented in the same manner as in Part I. Part 
III is a sunmary of the results. 
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PART I 
The Self Study 

The Evaluation Guide for Secondary Schools'* says "the self study is 
that part of the evaluation which is carried on by the faculty. It begins 
with the decision to carry on the evaluation and concludes when the 
faculty has agreed upon or revised the findings of the various work 
committees." Obviously, in terms of the total evaluation the self study 
is pre-eminent because it is in the initiatory position and because it 
provides the basis for the work of the visiting conmittee. 

Selection and Composition of the Steering Committee 

One of the first things to be done after the decision has been made 
to undergo an evaluation is the selection of the steering conmittee. It 
is the responsibility rf this committee to ensure that the purpose of the 
evaluation is carried out. To this end it usually selects, guides, and 
coordinates the work committees and selects the visiting committee. Its 
chairperson becomes a key person in the organization and coordination of 
the total evaluation. Therefore, the selection and composition of the steering 
committee and its chairper;on is critical to the total evaluation. 

Table I shows what the responding administrators and teachers thought 
of the effectiveness of procedures used in the selection and composition 
of the steering committee. The most frequently used procedure in the 
selection of the steering committee was selection by the administration. 
This procedure was also deemed to be the most effective in terms of 

^ Evaluation Guide for Secondary Schools , prepared by the Committee 
Accreditation Procedures of the Commission on Secondary Schools, North 
Central Association of Colleges and Secondary Schools, p. 9. 
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TABLE I 
(N=83) 



The Effectiveness in Terms of Evaluation of 
the Selection and Composition of the Steering 
Committee in NCA Evaluations as reported by 
Administrators and Teachers 



Steering Committee 
Selection & Composition 


Effectiveness in 
terms of Evaluation 


Use oi 
Procedi 


F 

jre 




Selection 


Least 
N % 


Some' 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 

N % 


1. 


Selected by faculty 


9 11 


14 17 


23 28 


8 10 


14 17 


63 76 


2. 


Selected from volunteers 
from faculty 


10 1? 


17 21 


13 16 


17 21 


23 28 


54 65 


3. 


Selected by administration 


4 5 


5 6 


26 31 


34 41 


62 75 


15 18 


4. 


Selected from a pool of 
elected faculty by 
administration 


11 13 


8 10 


22 27 


5 6 


4 5 


72 87 


5. 


Chairperson selected by 
f acul ty 


20 24 


9 11 


11 13 


6 7 


. 4 5 


71 86 


D. 


Lndi rperson seiecteo oy 
steering committee 


8 10 


8 10 


17 21 


18 22 


16 19 


61 74 


7. 


Chairperson selected by 

aHmi ni ^tratnr 


5 6 


5 6 


27 33 


29 35 


56 68 


21 25 


8. 


Chairperson an administr- 
tor 

Composition 


7 8 


5 6 


12 15 

1 


23 28 


34 41 


41 49 


9. 


Departments heads only 


15 18 


10 12 


12 15 


10 12 


16 19 


58 70 


10. 


Representation from each 
department or subject 
area 


2 2 


12 15 


16 19 


22 27 


21 25 


55 66 


11. 


Less than one from each 
department or subject 
area 


12 15 


13 16 


24 29 


13 16 


43 52 


32 39 


12. 


Experienced faculty only 


9 11 


4 5 


18 22 


37 45 


51 61 

1 


24 29 
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TABLE II 
(N=8) 

The Effectiveness in Terms of Evaluation of 
the Selection and Composition of the Steering 
Committee in NCA Evaluation as reported by 
Administrators and Teachers in Schools below 
200 enrollment. 



Steering Committee 
Selection & Composition 



Effectiveness in 
terms of Evaluatipn 



Use of 
Procedure 



Sel ecti on 

1. Selected by faculty 

2. Selected from volunteers 
from faculty 

3. Selected by administration 

4. Selected from a pool of elect- 
ed faculty by administration 

5. Chairperson selected by 
facul ty 

Chairperson selected by 
°- steering committee 

Chairperson selected by 
administrator 

8. Chairperson an administrator 



Composition 
9. Departments heads only 

10. Representation from each 
department or subject area 

11. Less than one from each 
department or subject area 

12. Experienced faculty only 



Least 
N % 



" 50 

1 13 
0 0 

3 38 

5 63 

2 25 

0 0 

2 25 



3 38 

0 0 

1 13 

2 25 



Some 
N % 



Moderate 
N % 



Most 
N % 



Yes 
N % 



1 13 

2 25 
0 0 

2 25 
0 



0 

2 25 



2 25 
4 50 

3 38 
0 0 



2 25 
4 50 

3 38 

1 13 

2 25 

2 25 

3 38 
2 25 



0 0 

2 25 

4 50 

2 25 



0 0 
0 0 
5 63 

0 0 

0 0 
3 38 

5 63 

1 13 



2 25 

1 13 

0 0 
4 50 



2 25 
1 13 
8 100 

0 0 

0 0 

1 13 

8 100 
1 13 



1 13 

2 25 

3 38 
5 63 



No 

N % 



6 75 

7 88 
0 0 

8 100 

8 100 

7 88 

0 0 
7 88 



7 88 

6 75 

5 63 

3 38 
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TABLt III 
{N^23) 

The Effectiveness in Terms of Evaluation 
of the Selection And Composition of the 
Steering Committee in NCA Evaluation as 
reported by Administrators and Teachers 
in Schools between 300 and 600 enrollment 



Steering Committee 
Selection & Composition 



Effectiveness in 
terms of Evaluation 



Use of 
Procedure 



M % 



Ho— 
N % 



Selection 

1. Selected by faculty 

2. Selected from volunteers 
from faculty 

3. Selected by administration 

4. Selected for a pool of 
elected faculty by 
administration 

5. Chairperson selected by 
f acul ty 

6. Chairperson selected by 
steering committee 

7. Chairperson selected by 
administrator 

8. Chairperson an administrator 

Composition 

9. Departments heads only 

10. Representation from each de- 
partment or subject area 

11. Less than one from each de- 
partment or subject area 

12. Experienced faculty only 



Least 
N % 



ERIC 



1 4 

4 17 
1 4 



1 4 

2 9 
2 9 

1 4 



1 4 
0 



Some 
N % 



1 4 

3 14 
0 

1 4 

2 9 



1 4 
0 

1 4 



4 17 
0 



Moderate 
N % 



7 30 

1 4 
6 26 

3 14 

2 9 
5 22 

4 17 

0 

3 14 
3 14 

8 78 
2 9 



Most 
N % 



4 17 
0 

8 35 

1 4 

2 9 
6 26 

5 22 
2 9 

2 9 

4 17 

2 9 

13 57 



6 26 

3 14 

16 70 

0 

1 4 

10 44 

10 44 

3 14 

4 17 

6 26 

14 61 

13 57 



10 



16 70 

18 78 
5 22 

21 91 

19 -as 

12 52 

10 44 

18 78 

17 74 
15 65 

7 30 

8 78 



TABLE IV 
(N=21) 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of the 
Steering Committee in NCA Evaluations as 
reported by Administrators and Teachers in 
Schools between 750 and 1000 enrollment 



Steering Committee 
Selection & Composition 


Effectiveness In 
terms of Evaluation 


Use of 
Procedu 


re 






Selection 


Least 
N % 


Some 
N % 


Moderate 
W % 


Most 
N % 


Yes 
N % 


No 
M 


% 


i: 


Selected by faculty 


C 


1 n 
1 u 


7 


■30 


Ci 
Q 








1 


5 


18 


86 


.2. 


Selected from volunteers 
from faculty 


o 
C 


ID 


0 


1 /I 


t) 


9/1 


0 




7 
/ 


00 


12 


57 


3. 


Selected by administration 


1 


5 


4 


19 


6 


29 


8 


38 


14 


19 


4 


19 


4. 


Selected from a pool of 
elected faculty by 

aHmi Y*fk ^inn 

uUIII III IdUi uv lUli 


4 


19 


2 


10 


8 


38 


1 


5 




0 


18 


86 


(; 

>j • 


rhairDprson ^plprtpH bv 

faculty 


8 


38 


3 


14 


3 


14 


1 


5 


1 


5 


17 


81 


f. 

o • 


Phairnpr^nn ^plprtpH bv 

Steering committee 


1 


5 


5 


24 


4 


19 


3 


14 




0 


18 


.86 


7 


Lnairperson seiectea oy 
administrator 


1 


5 


3 


14 


9 


43 


6 


29 


15 


71 


4 


19 


8. 


Chairperson an administrator 
Composition 




0 


2 


10 


3 


14 


10 


48 


14 


19 


C 

0 


OA 


9. 


Departments heads only 


6 


29 


3 


14 


4 


19 


2 


10 


6 


29 


12 


57 


10. 


Representation from each de- 
partment or subject area 


1 


5 


4 


19 


5 


24 


5 


24 


3 


14 


15 


71 


11. 


Less than one from each de- 
partment or subject area 


2 


10 


5 


24 


4 


19 


7 


33 


15 


71 


4 


19 


12. 


Experienced faculty only 


1 


5 


1 


5 


9 


43 


7 


33 


16 


76 


2 


10 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of the 
Steering Committee in NCA Evaluations as 
reported by Administrators and Teachers 
in Schools between 1500 and 2000 enrollment 



Steering Committee 
Sel ecti on-&- Compos i ti on 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Selection 


Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
M % 


Nc 
N 


% 


1. 


Selected by faculty 




0 


3 17 


5 28 


2 


n 


4 22 


14 


78 


2. 


Selected from volunteers 
from faculty 


1 


6 


5 28 


1 6 


6 


33 


7 39 


11 


61 


3. 


Selected by administration 


1 


6 


0 


8 44 


7 


39 


14 78 


3 


17 


4. 


Selected from a pool of 
elected faculty by 
aumm 1 s tration 


3 


17 


0 


4 22 


2 


. 11 


2 11 


15 


83 


^ • 


ufiairpcrbun seiecteo Dy 
faculty 


3 


17 


3 17 


1 6 


1 


6 


2 11 


16 


89 




Lnairpcrbon selected 
steering committee 


2 


11 


3 17 


1 6 


3 


17 


4 22 


14 


78 


7 


una 1 rperson se i ected Dy 
administrator 


1 


6 


0 


5 28 


9 


50 


13 72 


5 


28 


Q 

o. 


Chairperson an administrator 
Composition 




0 


0 


2 n 


9 


50 


11 61 


7 


39 


9. 


Departments heads only 


1 


6 


3 17 


2 (1 


3 


17 


4 22 


12 


67 


0. 


Representation from each de- 
partment or subject area 




0 


3 17 


1 6 


9 


50 


9 50 


8 


44 


1. 


Less than one from each de- 
partment or subject area 


5 


28 


0 


3 17 


2 


11 


6 33 


9 


50 


2. 


Experienced faculty only 


1 


6 




1 6 


11 


61 


11 61 


7 


39 
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TABLE VI 
(N=13) 

The Effectiveness in Te>^nis of Evaluation of 
the Selection and Composition of the Steering 
Committee in NCA Evaluation as reported by 
Administrators and Teachers in Schools over 
2000 enrollment. 



Steering Committee 

fiplprtinn R romnn<;i t.inn 




4- 


Effectiveness in 
' of Evaluation 




• 


Use of 
Procedure 




Col opt 1 f\t\ 
1 ci« C 1 Uil 


Lea' 

N . 


n 


.ne 
% 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1. 


Selected by faculty 


2 


15 


2 


15 


3 


23 


2 


15 


1 8 


9 


69 


2. 


Selected from Volunteers 
from faculty 


2 


15 


4 


30 


2 


15 


5 


39 


5 39 


6 


46 


3. 


Selected by administration 


1 


8 


1 


8 


3 


23 


6 


46 


10 77 


3 


24 


4. 


Selected from a pool of elect- 
ed faculty by administration 


1 


8 


3 


23 


6 


46 


1 


8 


2 15 


10 


77 


5. 


Chairperson selected by 
faculty 


4 


31 


1 


8 


3 


23 


2 


15 


0 0 


11 


85 


6. 


Chairperson selected by 
steering committee 


2 


15 


0 


0 


5 


39 


3 


23 


.1 8 


10 


77 


7. 


Chairperson selected by 
administrator 


1 


8 


1 


8 


6 


46 


4 


31 


10 77 


2 


15 


8. 


Chairperson an administrator 
Composition 


3 


23 


1 


8 


5 


*39 


1 


8 


5 39 


4 


31 


9. 


Departments heads only 


4 


31 


1 


8 


3 


23 


1 


8 


1 8 


10 


77 


0. 


Representation from each de- 
partment or subject area 


1 


8 


1 


8 


5 


39 


3 


23 


1 8 


r. 


85 


1. 


Less than one from each de- 
partment or subject area 


3 


23 


1 


8 


5 


39 


2 


15 


5 39 


7 


54 


?. 


Experienced faculty only 


5 


39 


2 


15 


4 


31 




'5 


6 46 


4 


31 
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TABLE VII 
(N=21) 



n 



The Effectiveness in Terms of Evaluation 
of the Selection and Composition of the 
Steering Committee in NCA Evaluations as 
reported by Administrators 



Steering Committe 
Selection & Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Selection 
Selected by faculty 


Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
M % 


No 
N 


% 


1. 


3 


14 


6 29 


6 


28 


2 


10 


8 


38 


1 1 


oc 


2. 


Selected fro volunteers from 
faculty 


2 


10 


8 38 


4 


19 


4 


19 


11 


52 


0 


43 


3. 


Selected by administration 


1 


5 


0 


6 


29 


11 


52 


17 


81 


3 


14 


4. 


Selected from a pool of 
elected faculty by 
administration 


7 


33 


3 14 


3 


14 


2 


10 


1 


5 


17 


81 


5. 


Chairperson selected by 
faculty 


9 


43 


2 10 


2 


10 


1 


5 


3 


14 


16 


76 


C. 


Chairperson selected by 
steering coinnittee 


3 


14 


3 14 


3 


14 


5 


24 




19 


15' 


71 


7. 


Chairperson selected by 
administrator 


1 


5 


1 5 


3 


14 


13 


62 


17 


81 


4 


19 


8. 


Chairperson an administrator 
Composition 


1 


5 


2 10 


2 


10 


8 


38 


10 


48 


10 


48 


9. 


Departments heads only 


5 


24 


2 10 


3 


14 


4 


19 


6 


29 


11 


52 


10. 


Representation from each de- 
partment or subject area 


1 


5 


5 24 


5 


24 


5 


24 


8 


38 


10 


47 


n. 


Less than one from eache de- 
partment or subject area 


5 


24 


2 10 


5 


24 


3 


14 


10 


48 


9 


43 


12. 


Experienced faculty only 


3 


14 


0 


5 


24 


. 10 


48 


15 


71 


4 


19 
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TABLE VIII 
(N=62) 

The Effectiveness in Terms of Evaluation of 
the Selection and Composition of The Steering 
Committee in NCA Evaluations as Reported by 



Steeri ng Conimi ttees 

Selection & Composition 


• 


Effectiveness in 
terms of Evaluation 






Use of 
Procedu 


re 


Selection 


Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


MO 

M 


% 


K Selected by facuUy 


C 


10 


8 


13 


17 27 


6 


10 


6 10 


52 


OA 

84 


2. Selected from volunteers 
from f acul ty 


8 


13 


9 


15 


9 15 


13 


21 


12 19 


45 


73 


3. Selected by administration 


3 


5 


5 


8 


20 32 


23 


37 


45 73 


12 


19 


4* Selected from a pool of 
e tec tea Tacuitjr ujr 
administration 


4 


7 


5 


8 


19 31 


3 


5 


3 5 


55 


89 


5. Chairperson selected by 
faculty 


11 


18 


7 


12 


9 15 


5 


8 


1 2 


55 


89 


6. Chairperson selected by 
steering committee 


5 


8 


5 


8 


14 23 


13 


21 


12 19 


46 . 


74 


7. Chairperson selected by 
administrator 


4 


7 


4 


7 


24 39 


16 


26 


39 63 


17 


27 


8. Chairperson an administrator 


6 


10 


3 


5 


10 16 


15 


24 


24 39 


31 


50 


Composition 






















9. Department Heads only 


10 


16 


8 


13 


9 15 


6 


10 


10 16 


47 


76 


10. Representation from each 
department or subject area 


1 


2 


7 


11 


11 18 


17 


27 


13 21 


45 


73 


11. Less than one from each 
department or subject area 


7 


11 


11 


18 


19 31 


10 


16 


33 53 


23 


37 


12. Experienced faculty only 


6 


10 


4 


7 


13 21 


27 


44 


36 58 


20 


32 



15 
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evaluation* The least used procedure was selection from a pool of elected 
faculty by administration* It was also regarded as least effective, as were 
the other procedures involving selection by the faculty of the steering committee* 
Having only experienced faculty on the steering committee was regarded by the 
greatest number of respondents as being most effective, far outstripping 
having only department heads as steering committee members* There was also 
strong indication that it was best to have representation from each department 
or subject area on the steering committee even though this was not the usual 
procedure employed. 

Response to the selection and composition of the steering committee by size 
of school as shown in tables II, III, IV, V, and VI indicates a consistency 
in the pattern of responses with the exception of those in the 300 to 600 size 
range where the selection of the chairperson by the steering committee was 
given a slightly higher effectiveness ratio than selection by the administrator* 
Tables VII and VIII show the administrators and teachers generally agreed 
on the procedure for selecting and composing the steering committee. 

Selection and Composition of the Work Committees 

The functions of the work coirmittees in an NCA evaluation are to collect 
data about existing programs or services, to identify areas of strength and 
weakness, and to make recommendations for improvement as they see the need* 
In effect they provide the data, along with their analysis of it, from which 
the visiting committee makes a substantial portion of their judgment about the 
programs and the services of the school* The work committee system also 
provides a vehicle by which the total faculty can be involved in the evaluative 
process* Therefore, their selection and composition is a vital aspect of 
the total evaluation if a good self evaluation is to ensue* 
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The administrators and teachers involved in this study responded as shown 
on table IX to the effectiveness and use of various procedures in selecting 
and composing the work committees of an NCA evaluation. Selection by the 
steering committee was the procedure most utilized. It was also felt to be 
most effective in terms of evaluation by a plurality of respondents. Having 
work comfni ttees selected by the department chairperson was judged least 
effective and was least used. 

The composition and participation of work committees was fairly 
consistent with NCA recommendations. Interdepartmental or interdisciplinary 
membership and total faculty participation on at least one committee, with 
committee size greater than three, were widely used procedures and were 
generally regarded as effective. Contrasted to the composition of steering 
committee, however, the respondents generally felt that service on a ^^^^ 
committee should not be limited to experienced faculty. This was not 
regarded as a popular procedure insofar as utilization and effectiveness 
are concerned; nor was membership solely from a depat^cment or subject area and 
committee size equal to or less than t.nree. 

Response hy size of school to the selection and composition of the work 
cot.mi ttees indicates no large differences from the general pattern except 
that the use of volunteers on work committees was more frequent and was regarded 
as more effective than any other in schools with over 2,000 enrollment. 
Tables X, XI, XII, XIII, and XIV show results by size. Tables XV and XVI show 
general agreement by administrators and teachers with regard to the selection 
and composition of work committees for an NCA evaluation with administrators 
indicating more of an inclination towards volunteer faculty in this respect. 
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TABLF. IX 
(N=83) 

The Efiectiveness in Terms of Evaluation of 
the Selection and Composition of Work 
Committees in NCA Evaluations as reported by 
Administrators and Teachers 





Work Committees 
Selection & Composition 


Effectiveness in 
terms of Evaluation 


Use 0 
Procec 


f 

ure 




Selection 


Least 
N % 


Some 
N % 


Moderate 

N % 


Most 
N % 


Yes 
N % 


No 
N % 


1 ^ 


Selected by faculty in 
each department 


4 5 


7 8 


18 22 


16 19 


15 18 


56 68 


2. 


Vol unteers 


4 5 


9 11 


16 19 


20 24 


28 34 


43 52 


3. 


Selected by steering 
commi ttee 


2 2 


6 7 


26 31 


39 47 


57 69 


20 24 


4. 


Selected by administration 


6 7 


11 13 


23 28 


12 15 


22 27 


50 60 


5. 


Selected by department 
cha-rperson 

Composition 


12 15 


16 19 


11 13 


4 5 


12 15 


61 74 


6. 


Experienced faculty only 


16 19 


11 13 


9 11 


15 18 


16 19 


56 68 


7. 


Interdepartmental or inter- 
disciplinary membership 


3 4 


4 5 


27 33 


39 47 


64 77 


10 12 


8. 


Membership solely from depart- 
ment or subject area 


18 22 


15 18 


6 7 


10 12 


10 12 


62 75 


9. 


Total faculty participation 
on at least one committee 


4 5 


2 2 


17 21 


53 64 


65 78 


14 17 


10. 


Faculty participation on 
more than two committees 


10 12 


15 18 


26 31 


14 17 


39 47 


28 34 


11. 


Committee size equal to or 
less than three 


17 21 


11 13 


19 23 


13 16 


26 31 


44 53 


12. 


Committee size greater than 
three 


1 1 


5 6 


29 35 


31 37 


54 65 


18 22 
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TABLE X 
(N=8) 

The Effectiveness in Terms of Evaluation of 
the Selection and Composition of Work 
Committees in NCA Evaluations as reported by 
Administrators and Teachers in Schools below 
200 enrollment. 
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Work Committees 
Selection & Composition 



Effectiveness in 
terms of Evaluation 



Use of 
Procedure 



Selection 

1. Selected by faculty in each 
department 

2. Volunteers 



Least 
N % 



3 38 
0 0 



3. Selected by steering committee 0 0 



4. Selected by administration 

5. Selected by department 
chai rperson 

Composition " 

6. Experienced faculty only 

7. Interdepartmental or inter- 
disciplinary membership 

8. Membership solely from depar 
ment or subject area 

9. Total faculty participation 
on at least one committee 

10. Faculty participation on 
more than two committees 

11. Committee size equal to or 
less than three 

12. Cojuii ttee size greater than 
three 



ERIC 



1 13 

2 25 

4 50 

1 13 

3 38 
1 13 
1 13 
3 38 
1 13 



Some 
N % 



1 13 

1 13 

2 25 

2 25 

3 38 

0 0 

0 0 

2 25 

0 0 

1 13 
1 13 
1 13 



Moderate 
N % 



2 25 
7 88 
4 50 

3 38 

1 13 

1 13 

2 25 
0 0 

4 50 

5 63 
2 25 
2 25 



Most 
N % 



Yes: 
M % 



1 13 

0 0 

2 25 
2 25 

1 13 

2 25 
5 63 

2 25 

3 38 

1 13 

2 25 

3 38 



1 13 

3 38 
7 88 

5 63 

1 13 

4 50 

6 75 

3 38 

5 63 

6 75 

4 50 

5 63 



No 

N % 



6 75 
4 50 

1 13 

3 38 

7 88 

4 50 

2 25 

5 63 

3 38 

2 25 

4 50 

3 38 
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TABLE XI 
(N=23) 



17 



The Effectiveness in Terms of Evaluation 
of the Selection and Composition of Work 
Committees in NCA Evaluations as reported 
by Administrators and Teachers in Schools 
between 300 and 600 enrollment 



Work Committees 
Selection and Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Selection 

Selected by faculty in each 
department 


Least 

N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
M % 


No 

N % 


1. 




0 


0 


1 4 


4 


17 


3 


14 


17. 


74 


2. 


Volunteers 


1 


4 


0 


0 


2 


9 




0 


20 


87 


3. 


Selected by steering 
convni ttee 




0 


0 


5 22 


11 


48 


12 


52 


10 


44 


4. 


Selected by administration 


1 


4 


0 


2 9 


5 


22 


5 


22 


15 


65 


5. 


Selected by department 
chairperson 

Composition 


1 


4 


2 9 


1 4 




0 




0 


20 


87 


6. 


Experienced faculty only 


1 


4 


0 


0 • 


5 


22 


5 


22 


15 


65 


7. 


Interdepartmental of interdis 
ciplinary membership 


2 


9 


0 


8 34 


7 


30 


15 


65 


6 


26 


8. 


Membership solely from 
department of subject area 


2 


9 


2 9 


o" 


1 


4 


4 


17 


16 


70 


9. 


Total faculty participation 
on at least one committee 




0 


1 4 


5 22 


15 


65 


19 


83 


2 


9 


10. 


Faculty particiaption on 
more than two committees 


3 


14 


1 4 


6 26 


7 


30 


15 


65 


5 


22 


11. 


Committee size equal to or 
less than three 


1 


n 
t 


1 4 


5 22 


0 

c 


q 


o 




1 c 


itC 


1 c. • 


LOiiiiii k kcc sizc greater tnan 
three 




0 


2 9 

20 


9 39 


5 


22 


12 


52 


9 


39 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of Work 
Committees in NCA Evaluations as reported 
by Administrators and Teachers in Schools 
between 750 and 1000 enrollment 



Work Committees 
Selection and Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedu 


re 




Selection 


Least 

N % 


Some 
N % 


Moderate 
« % 


Most 
N % 


Yes 
N % 


Ml 

M 


f/ 
















■ 












1. 


Selected by faculty in each 
department 


1 


5 


2 


10 


9 


43 


5 


24 


4 


19 


14 


67 


2. 


Volunteers 


1 


5 


3 


14 


4 


19 


7 


33 


9 


43 


9 


43 


3 


Selected bv sterrinq conmittee 


1 


5 


1 


5 


9 


43 


9 


43 


14 


68 


3 


14 


4. 


Selected by administration 


1 


5 


5 


24 


8 


38 


3 


14 


4 


19 


14 


67 


5. 


Selected by department 
chairperson 

Composition 


2 


10 


6 


29 


6 


29 


2 


•10 


8 


38 


11 


52 


6. 


Experienced 'faculty -only 


0 


14 


c 
6 




o 




4 


ly 


o 
C 


1 n 
lU 


16 


76 


7. 


Interdepartmental or interdis- 
ciplinary membership 




0 


2 


10 


6 


29 




52 


18 


86 

UK/ 


0 . 


Q 
O* 


MemDersmp soieiy trom 
department or subject area 


5 


24 


3 


14 


3 


14 


5 


24 




0 


18 


86 


9. 


Total faculty participation 
on at least one committee 


2 


10 


1 


5 


4 


19 


12 


57 


T4 


67 


6 


29 


10. 


Faculty participation on more 
than two committees 


3 


14 


4 


19 


7 


33 ■ 


3 


14 


13 


62 


7 


33 


n. 


Committee size equal to or 
less than three 


3 


14 


5 


24 


6 


29 


3 


14 


8 


38 


11 


52 


12. 


Committee size greater than 
three 




0 


1 


5 


8 


38 


8 


38 


16 


76 


2 


10 
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TABLE Xni 
{N=18) 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of Work 
Committees in NCA Evaluations as reported 
by Administrators and Teachers in Schools 
between 1500 and 2000 enrollment 



Work Committees 
Selection & Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Selection 


Least 

N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1. 


Selected by faculty in each 
department 




0 


3 


17 


2 11 


3 


17 


5 28 


IT 


61 


2. 


Volunteers 


Z 


11 


3 


17 


4 22 


3 


17 


6 33 


9 


50 


3. 


Selected by steering 
committee 




0 


1 


6 


4 22 


11 


61 


15 83 


2 


11 


4. 


Selected by administration 


1 


6 


1 


6 


7 39 


2 


n 


7 39 


9 


50 


5. 


Selected by department 
chairperson 

Composition 


3 


17 


3 


17 


2 11 




0 


1 6 


15 


83 


6. 


[experienced faculty only 


2 


11 


3 


17 


2 11 


4 


22 


11. 61 


16 


89 


7. 


Interdepartmental or interdis- 
c i pi i nary members hip 




0 


2 


11 


4 22 


11 


61 


16 89 




0 


8. 


Membership solely from 
department or subject area 


2 


11 


5 


28 


2 11 


; 

1 

1 


6 


3 17 


13 


72 


9. 


Total faculty participation 
on at least one committee 


1 


6 




0 


3 17 


13 


72 


17 94 




0 


10. 


Faculty participation on 
more than two committees 


3 


17 


5 


28 


3 17 


1 


6 


5 28 


11 


61 


11. 


Corranittee size equal to or 
less than three 


5 


28 


1 


6 


4 22 


• 4 


22 


5 28 


9 


50 


12. 


Committee size greater than 




0 




0 


7 39 

J 


8 


44 


12 67 


2 


11 
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TABLE XIV 
{N=13) 

The Effectiveness in Terms of Evaluation of 
the Selection and Composition of Work Committees 
in NCA Evaluations as reported by Administrators 
and Teachers in Schools over 2000 enrollment. 



Work Committee 
Selection & Comoosition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Selection 

Selected by faculty in each 
department 


Least 

N % 


Some 

fi lo 


Moderate 

IN * 


Most 
N % 


Yes 
n h 


No 

N 


to 


1. 


0 


0 


1 8. 


4 31 


i 


CO 


2 15 


8 


62 


2. 


Volunteers 


0 


0 


2 15 


1 o 

1 o 


8" 


62 


1 n 77 
1 U // 


1 
1 


p 
o 


3. 


Selected by steering committee 


1 


8 


2 15 


4 31 


6 


46 


9 69 


4 


31 


4. 


Selected by adminstration 


2 


15 


3 23 


3 23 


n 
u 


n 
u 


1 8 


9 


69 


5. 


Selected by department 
chai rperson 

Composition 


4 


31 


2 15 


1 8 


1 


Q 

O 


2 15 


8 


62 


6. 


Experienced faculty only 


6 


46 


2 15 


3 23 


0 


0 


1 8 


9 


69 


-f 
/ • 


Interdepartmental or interdis- 
ciplinary membership 


0 


0 


0 0 


7 54 


5 


39 


9 69 


2 


15 


8. 


Membership solely from depart- 
ment or subject area 


6 


46 


3 23 


1 8 


1 


8 


0 0 


10 


77 


9. 


Total faculty participation on 
at least one committee 


0 


0 


0 0 


1 8 


10 


77 


10 77 


3 


23 


10. 


Faculty participation on more 
than two committees 


n 
u 


n 


4 31 


5 39 


2 


15 


6 46 


3 


23 


11 . 


Committee size equal to or 
less than three 


5 


39 


3 23 


2 15 


2 


15 


1 8 


8 


62 


12. 


Committee size greater than 
three 


0 


0 


1 8 


3 23 


7 


54 


9 69 


2 


15 
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TABLE XV 
(N=21) 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of Work 
Committees in NCA Evaluations as reported 
by Administrators 





Work Committees 
oeiection a composition 


1 


Effectiveness in 
terms of Evaluation 






Use of 
Procedure 






Selection 


Least 

N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1. 


Selected by faculty in each 
aepar tinen t 


2 


10 


1 5 


6 29 




t*t 


8 38 


11 


52 


Cm 


VO lun teers 


1 


5 


4 19 


7 33 


5 


24 


m Aft 


q 


43 


3. 


Selected by steering committee 


1 


5 


2 10 


6 29 


11 


52 


15 71 


5 


24 


4. 


Selected by administration 


1 


5 


5 24 


4 19 


3 


14 


5 24 


13 


62 


c 

3. 


oeiectea oy aepartment 
chairperson 

Composition 


5 


24 


5 24 


1 5 


3 


14 


a 14 


15 


71 


6. 


Experienced faculty only 


5 


24 


4 19 


2 10 


3 


14 


5 24 


13 


62 


7. 


Interdepartmental or 
interdisciplinary membership 


2 


10 


0 


8 38 


10 


48 


17 81 


3 


14 


8. 


Membership solely from 
department or subject area 


6 


29 


3 14 


1 5 


3 


14 


6 29 


12 


57 


9. 


Total faculty participation on 
at least one committee 


1 


5 


0 


7 33 


13 


62 


18 86 


3 


14 


0. 


Faculty participation on more 
than two committees 


2 


10 


4 19 


10 48 


1 


5 


11 52 


8 


38 


1. 


Committee size equal to or 
less than three 


6 


29 


3 14 


5 24 


2 


10 


8 38 


9 


43 


2. 


Committee size greater than 
three 




0 


2 10 


9 43 


9 


43 


16 76 


3 


14 
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TABLE XVI 
(N=62) 

The Effectiveness in Terms of Evaluation 
of the Selection and Composition of Work 
Committees in NCA Evaluations as Reported 
By Teachers. 
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Work Committees 
Selection and Composition 



Selection 

1. Selected by faculty in each 
department 

2. Volunteers 

3. Selected by steering committee 

4. Selected by administration 

5. Selected by department 
chairperson 

Composition 

6. Experienced faculty only 

7. Interdepartmental or inter- 
disciplinary membership 

8. Membership solely from 
department or subject area 



9. Total faculty participation 
on at least one committee 

10. Faculty participation on 
more than two committees 

11. Committee size equal to or 
less than three 

12. Committee size greater than 
three 



Effectiveness in 
terms of Evaluation 



Use of 
Procedure 



Least 

N % 



2 
3 
1 
5 



7 11 

11 18 
1 2 

12 19 
3 5 

8 13 
11 18 

1 



Some 
N % 



6 10 

5 8 
4 7 

6 10 

11 18 

7 11 
4 7 

12 19 

2 3 
11 18 

8 13 

3 5 



Moderate 
N % 



12 19 

9 15 

20 32 

19 31 

10 16 

7 11 

19 31 
5 8 

10 16 

16 26 

14 23 

20 32 



Most 
N % 



Yes 
M % 



n 


18 


7 


60 


45 


73 


15 


24 


18 


29 


34 


55 


28 


45 


42 


68 


15 


24 


9 


15 


17 


27 


37 


60 



1 2 9 15 

12 19 11 18 
29 47 47 76 

7 111 4 7 

40 65 47 76 

13 21 28 45 
11 ia 18 29 
22 38 38 61 
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The Activities of the Self Study Comnittees 

The variety of activities engaged in by the self study committees in an 
NCA evaluation as shown on table XVII revolve primarily around the need to 
gather, organize and analyze data so that recommendations can be made and so 
that the visiting committee can have a basis from which they can make their 
evaluation. It comes as no surprise then that the activities most frequently 
used, and which were regarded by the largest number as most effective, were 
gathering and analyzing data, summarizing, and identifying strengths and weak- 
nesses with recommendations for change. Others having frequent use with 
relatively high effectiveness ratings, were sharing data and seeking feedback 
within respective departments or subject areas, having individuals responsible 
for completing certain sections of the Evaluative Criteria, having general 
discussion within departments or areas on all sections of the Criteria, and 
modifying the Criteria to fit the needs of the school. While the activities 
involving the sharing of data with the total faculty were indicated as being 
engaged in by a majority of the respondents they did not receive the support 
given the aforementioned activities. The activity of using outside consultants 
in the self study was the least used and its effectiveness was generally 
the lowest rated. There was much use of board and community members in the sel 
study but reluctance to support their effectiveness in the evaluative process. 

The pattern of responses by size of school as shown in tables XVIII, 
XIX, XX, XXI and XXII does not vary much from the general pattern as described 
above. The smaller the school, of course, the more totally involved the 
faculty was in sharing all the data generated by the various self study 
conmittees. Also, administrators saw more of a need for the sharing of data 
by the total faculty than did teachers. Otherwise, tables XXIII and XIV 
show similar responses by these two groups. 
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TABLE XVII 
(N=83) 

The Effectiveness in Terms of Evaluation of 
Selected Activities of Self Study Committees 
in NCA Evaluations as reported by Administrators 
and Teachars 



Activities of Self Study Committee; 


5 1 


iffectiv 
jrms of 


'eness in 
Evaluatijc 


)n 


Use c 
Procec 


If 

lure 






Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 

N 




1. 


Gathering and analyzing data 


n 
U 


n 
u 


4 5 


Co 


CO 


50 60 


75 90 


6 


7 


2. 


Sharing data in total 
faculty meetings 


2 


2 


12 15 


20 


24 


32 39 


50 60 


30 


36 


3. 


Sharing data through writcen 
reports to total faculty 


3 


4 


10 12 


33 


40 


23 28 


49 59 


^1 
0 1 


Of 


4. 


Seeking feedback of total 
faculty in faculty meetings 


2 


2 


11 13 


29 


35 


24 29 


49 59 






5. 


Sharing data and seeking 
feedback within respective 
departments or subject areas 


2 


2 


6 7 


00 




41 49 


t 

66 80 


14 


17 


6. 


Individuals responsible for 
completing certain sections 
of Evaluative Criteria 


4 


5 


8 10 


28 


34 


34 41 


58 70 


19 


23 


7. 


Ge. "al discussion within 
departments or areas on all 
sections of the Criteria 


1 


1 


14 17 


18 


22 


43 52 


61 74 


16 


19 


8. 


Using outside consultants 

1 n col "f c ^iiHv 


7 


8 


13 16 


24 


29 


15 18 


32 39 


44 


53 


9. 


Modifying Criteria to needs 
of school 


2 


2 


4 5 


23 


28 


37 45 


58 70 


17 


21 


10. 


Involving board members in 
self study 


2 


2 


14 17 


21 


25 


30 36 


52 63 


24 


29 


11. 


Involving community members 
in self study 


2 


2 


15 18 


20 


24 


33 40 


52 63 


25 


30 


12. 


Summarizing & identifying 
strengths, weaknesses with 
recommendations for change 


0 


0 


3 4 


16 


19 


5fa 70 


74 89 


5 


6 
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TABLE XVIII 
(N=8} 

The Effectiveness in Terms of Evaluation of 
Selected Activities of Self Study Committees 
in NCA Evaluations as reported by Administrators 
and Teachers in Schools below 200 enrollment. 



Activities of Self Study Committees 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 






Least 

N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1. 


Gathering and analyzing data 


0 


0 


2 


25 


0 0 


6 


75 


8 100 


0 


0 


2. 


Sharing data in total faculty 
meetings 


0 


0 


1 


13 


U U 


7 


88 


ft inn 


0 


0 


3. 


Sharing data through written 
reports to total faculty 


0 


0 


1 


13 


5 63 


2 


25 


7 88 


1 


13 


4. 


Seeking feedback of total 
faculty in faculty meetings 


0 


0 


1 


13 


2 25 


5 


63 


8 100 


0 


0 


5. 


Sharing data and seeking feed- 
back within respective depart- 
ments or subject areas 


0 


0 


1 


13 


1 10 


6 


75 


7 88 


1 


13 


6. 


Individuals responsible for com- 
pleting certain sections of 
Evaluative Criteria 


n 
U 


n 

U 


1 
1 


1 J 


1 13 


6 


75 


8 100 


0 


0 


7. 


General discussion withm de- 
partments or areas on all sec- 
tions of the Criteria 


0 


0 


4 


50 


0 0 


4 


50 


5 63 


3 38 


8. 


Using outside consultants in 
self study 


1 


13 


1 


13 


5 63 


1 


13 


3 38 


5 


63 


9. 


Modifying Criteria to needs of 
school 


0 


0 


1 




2 25 


c 
0 


DO 


a 100 


0 


0 


10. 


Involving board members in self 
study 


0 


0 


1 


13 


2 25 


5 


63 


8 100 


0' 


0 


11. 


Involving community members in 
self study 


0 


0 


3 


38 


0 0 


5 


63 


7 8£ 


1 


13 


12. 


Summarizing & identifying 
strengths, weaknesses with 
recommendations for change. 


0 


0 


1 


13 

28 


1 13 


6 


75 


8 IOC 


0 
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(N-23) 
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The Effectiveness in Terms of Evaluation 
of Selected Activities of Self Study 
Committees in NCA Evaluations as reported 
by Administrators and Teachers in Schools 
between 300 and 600 enrollment. 



Activities of Self Study 
f.nmmi ttp*»<; 


Effectiveness in 
terms of Evaluation 


Use of 
Procedu 


re 






Least 
N % 


Some 
N * 


Moderate 

N % 


Most 
N % 


Yes 
N % 


NO 

N 


to 


1. 


Gathering and analyzing 
data 


0 




2 9 


8 \35 


11 


49 


20 87 


2 


9 


2. 


Sharing data in total 
faculty meetings 


0 




3 14 


6 26 


8 


35 


15 65 


7 


30 


3. 


Sharing data through 
written reports to total 
faculty 


0 




4 17 


11 22 


3 


14 


^2 52 


10 


44 


4. 


Seeking feedback of total 
faculty in faculty meetings 


0 




2 9 


5 22 


9 


39 


14 61 


8 


35 


5. 


Sharing data and seeking 
feedback within respective 
departments or subject areas 


0 




2 9 


13 57 


6 


26 


17 74 


5 


22 


6. 


Individuals responsible for 
completing certain sections 
of Evaluative Criteria 


1 


4 


0' 


10 '44 


8 


35 


17 74 


6 


26 


7. 


General discussion within 
departments or areas on all 
sections of the Criteria 


1 


zr 


1 4 


9 39 


11 


48 


19 83 


4 


17 


8. 


Using outside consultants 
in self study 


1 


4 


2 9 


6 26 


4 


17 


9 39 


14 


61 


0 

^ • 


Modifying Criteria to needs 
of school 


1 


4 


1 4 


5 22 


9 


39 


15 65 


8 


35 


10. 


Involving board members 
in self study 


0 




4 17 


3 14 


7 


30 


10 44 


13 


57 


11. 


Involving Community 
members in self study 


0 




5 22 


3 14 


7 


30 


TO 44 


13 


57 


12. 


Summarizing & identifying 
strengths, weaknesses 
with recommendations for 
change 


0 




0 


7 30 


15 


65 


21 91 


1 


4 



ERIC 



TABLE XX 
{N=21) 

The Effectiveness in Terms of Evaluation 
of Selected Activities of Self Study 
Committees in NCA Evaluations as reported 
by Administrators and Teachers in 
Schools between 750 and 1000 enrollment 
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Action ties of Self Study 
Commi ttees 



1. Gathering and analyzing data 

2. Sharing data in total faculty 
meetings 

3. Sharing data through written 
reports to total faculty 

4. Seeking feedback of total 
faculty in faculty n^eetings 

5. Sharing data and seeking 
feedback within respective 
departments or subject areas 

6. Individuals responsible for 
completing certain sections 
of Evaluative Criteria 

7. General discussion within 
departments or areas on all 
sections of the Criteria 

8. Using outside consultants 
in self study 

9. Modifying Criteria to needs 
of school 

10. Involving board members in 
self study 

11. Involving community members 
in self study 

12. Summarizing & identifying 
strengths, weaknesses with 
recommendations for change 



ERiC 



Effectiveness in 
terms of Evaluation 



Least 
N % 



1 5 



2 10 



2 10 



2 10 



1 5 



Some 
N % 



5 24 



2 10 



3 14 



2 10 



1 5 



3 14 



1 5 



2 10 



Moderate 
N % 



8 38 



6 29 



9 43 



12 57 



1 5 



10 48 



1 5 



6 29 



7 33 



12 57 



8 38 



2 10 



Most 
N % 



12 57 



6 29 



4 19 



2 10 



16 76 



8 38 



17 81 



7 33 



9 43 



Use of 
Procedure 



8 38 



16 76 



Yes 
M % 



19 91 



8 38 



10 48 



8 38 



18 86 



15 71 



17 81 



10 48 



16 76 



7 33 14 67 



15 71 



17 81 



No 

M % 



30 



2 10 



12 57 



10 48 



13 62 



3 14 



4 19 



1 5 



8 38 



2 10 



4 19 



3 14 



2 10 



TABLE XXI 
(N=18) 



28 



The Effectiveness in Terms of Evaluation 
of Selected Activities of Self Study 
Committees in NCA Evaluations as reported 
by Administrators and teachers in Schools 
between 1500 and 2000 enrollment 



Activities of Self Study 
Committees 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 






Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1 


f?r)^hprinn ?\ nH r)nr)l\/7inn fi^kf^k 

liiv^ ulIU uiluljr^lilVj UuvQ 




0 


n 


5 


28 


11 


61 


17 

1 / 


t 




2, 


Sharing data in total 
faculty meetings 


1 


6 


2 n 


5 


28 


4 


22 


n 61 


7 


39 


3. 


Sharing data through written 
reports to total faculty 


1 
1 


0 


2 n 




OQ 
CO 


/ 


39 


11 61 


7 


39 


4 


faculty in faculty meetings 




n 


3 17 


7 






1 1 


n 61 


7 


39 


5 


oiiai 1 11^ Uuvu uiiU oCCfNillVJ 

feedback within respective 
departments or subject areas 




0 


0 


10 


57 


7 


39 


16 89 


2 


n 


6. 


Individuals responsible for 
completing certain sections 

O'f Fx/a 1 iia ^1 VP nri^pria 


2 


n 


4 22 


2 


11 


8 


44 


II D 1 


c 
»> 


CO 


7. 


General discussion within 

HpHrtrtniPnt^ nr r)rPr)Q on r)l1 

UCpui vlllCllvd UI ui CQO Ull U 1 1 

sections of the Criteria 




0 


4 22 


8 


44 


4 


22 


13 72 


4 


22 


8. 


Using outside consultants in 
self study 


2 


n 


4 22 


4 


22 


1 


6 


6 33 


10 


56 


9. 


Modifying Criteria to needs 
of school 


1 


6 


0 


6 


33 


7 


39 


12 67 


3 


17 


10. 


Involving board members in 

bell bt'juy 


1 


6 


A OO 


3 


17 


6 


33 




h 


LC 


11. 


Involving community members 
is self study 


1 


6 


2 n 


7 


39 


6 


33 


11 61 


6 


33 


12. 


Summarizing & identifying 
strengths, weaknesses with 
recommendations for change. 




0 


1 6 


5 


28 


11 


61 


16 89 


1 


6 



ERIC 
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TABLE XXII 
(N=13) 

The Effectiveness in Terms of Evaluation of 
Selected Activities of Self Study Committees 
in NCA Evaluations as reported by Administrators 
and Te-chers in Schools over 2000 enrollment. 



Activities of Self Study Committee 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Least 

N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1. Gathering and analyzing data 


U 


n 
U 


n 
u 


n 


? 


15 


10 77 


11 85 


1 


8 


2. Sharing data in total faculty 
meetings 


0 


0 


1 


8 


3 


23 


7 54 


8 62 


4 


31 


3. Sharing data through written 
reports to total faculty 


0 


0 


1 


8 


3 


23 


7 54 


9 69 


3 


23 


4. Seeking feedback of total 
faculty in faculty meetings 


0 


0 


2 


15 


3 


23 


6 46 


8 62 


4 


31 


5. Sharing data and seeking feed- 
back within respective depart- 
ments or subject areas 


0 


n 
U 


1 
1 


0 

o 


A 


0 1 


6 46 


8 62 


3 


23 


6. Individuals responsible for com- 
pleting certain sections of 
Evaluative Criteria 


1 


8 


2 


15 


5 


39 


4 31 


7 54 


4 


31 


7. General discussion within depari 
ments or areas on all sections 
of the Criteria 


0 


0 


5 


31 


0 


0 


7 54 


7 54 


4 


31 


8. Using outside consultants in 
self study 


2 


15 


3 


23 


3 


23 


2 15 


4 31 


7 


54 


9. Modifying Criteria to needs of 
school 


0 


0 


1 


8 


3 


23 


7 54 


7 54 


4 


31 


10. Involving board members in self 
study 


1 


8 


5 


31 


1 


8 


4 31 


5 39 


5 


39 


11. Involving community members in 
self study 


1 


8 


3 


23 


2 


15 


7 54 


9 69 


2 


15 


12. Summarizing & identifying 
strengths, weaknesses with 
recommendations for change. 


0 


0 


1 


8 


1 


8 


10 77 


12 92 


1 


8 



TABLE XXIII 
(N-21 ) 

The Effectiveness in Terms of Evaluation 
of Selected Activities of Self Study 
Committees in NCA Evaluations as reported 
by Administrators 
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Activities of Self Study 
Committees 



1. Gathering and analyzing data 

2. Sharing data in total faculty 
meetings 

3. Sharing data through written 
reports to total faculty 

4. Seeking feedback of total 
faculty in faculty meetings 

5. Sharing data and seeking feed- 
back within respective 
departments or subject areas 

6. Individuals responsible for 
completing certain sections 
of Evaluative Criteria 

7. General discussion within 
departments or areas on all 
sections of the Criteria 

8. Using outside consultants in 
self study 

9. Modifying Criteria to needs of 
school 

10. Involving board members in sel 
study 

11. Involving community members 
in self study 

12. Summarizing & identifying 
strengths weaknesses with 
recommendations for change. 



ERIC 



Effectiveness in 
terms of Evaluation 



Least 

N % 



1 5 



2 10 



2 10 



1 5 



1 5 
0 



Some 
N % 



Moderate 
N % 



3 14 

2 10 
1 5 

3 14 

3 14 
5 24 

4 19 

4 19 

3 14 

5 24 

4 19 
1 5 



5 24 

7 33 

10 48 

10 48 

10 48 

5 24 

5 24 

6 29 

5 24 

7 33 

6 29 
5 24 



Most 
N % 



13 62 

9 43 

6 29 

5 24 

7 33 

7 33 

9 43 

2 10 

6 29 

6 29 

7 33 
12 57 



Use of 
Procedure 



Yes 
N % 



21 100 

16 76 

13 62 
16 76 

18 86 

15 71 

15 71 

6 29 

11 52 

14 67 

12 57 
18 86 



No 

N % 



0 

4 19 
7 33 

5 24 

3 14 

4 19 

3 14 
11 52 

6 29 

4 19 

5 24 
0 



33 



31 



TABLE XXIV 
{N=62) 

The Effectiveness in tenns of Evaluation of 
Selected Activities of Self Study Committees 
in NCA Evaluations as reported by Teachers. 



Activities of Self Study 
Commi ttees 



1 



Gathering and analyzing data 



2. Sharing data in total faculty 
meetings 

3. Sharing data through written 
reports to total faculty 

4. Seeking feedback of total 
faculty in faculty meetings 

5. Sharing data and "seeking 
feedback within respective 
departments or subject areas 

6. Individuals responsible for 
completing certain sections 
of Evaluative Criteria 

7. General discussion within 
departments or areas on all 
sections of the Criteria 

8. Using outisde consultants 
in self study 

9. Modifyim Criteria to needs 
of schc 

10. Involving board members in 
self study 

11. Involving community members 
in self study 

12. Summarizing & identifying 
strengths, weaknesses with 
recommendations for change 



Effectiveness in 
terms of Evaluation 



Least 

N % 



0 0 



2 3 



2 3 



2 3 



2 3 



1 2 



5 8 



1 2 



2 3 



1 2 



0 0 



Some 
N % 



1 2 



10 16 



9 15 



8 13 



2 3 3 5 



3 5 



10 16 



9 15 



Moderate 
N % 



9 15 



11 18 



ERIC 



18 29 



13 21 



23 37 



19 31 



19 31 



23 37 



13 21 



18 29 



18 29 



14 23 



14 23 



11 18 



Most 
N % 



34 



37 60 



23 37 



17 27 



19 31 



34 55 



27 44 



34 55 



13 21 



31 50 



24 39 



26 42 



46 74 



Use of 
Procedure 



N % 



54 87 



34 55 



36 58 



33 53 



48 77 



43 69 



46 74 



26 42 



47 76 



38 61 



40 65 



56 90 



No 

N % 



6 10 



26 42 



24 39 



27 44 



11 18 



15 24 



13 21 



33 53 



11 18 



20 32 



20 32 



8 



3^ 



PART II 
The Visitation 

2 

The Evaluation Guide for Secondary Schools says the "the accent 
of the visitation is upon school improvement rather than accreditation 
status" and that, therefore, "the visiting committee members come to the 
school as consultants, not as critics." It is in this spirit, then, that 
the visitation should proceed upon the completion of the self study. Contingent 
upon this, however, is the selection, composition, and activities of the 
visiting committee. It is through the processes of selection and composition 
that much can be done to enhance the consultative rather than the critic 
role of the visiting committee so that the school may have the benefit 
of new ideas. And it is through the activities of the visiting conmittee 
that this attitude is consummated. 

Selection and Composition of the Visiting Committee 

The composition of the visiting committee in an NCA evaluation reflects 
to some degree the particular needs of the school. Yet, there are certain 
basic selection procedures which are related to the total effectiveness 
of the evaluation. This is evident in the responses that the administrators 
and teachers have made to the survey queries in this area. For instance, on 
table XXV it is quite clear that they not only used but preferred specialists 
in the area to be evaluated. It is also clear that they did not generally 
use or want visiting committee members from only secondary schools or 
only colleges. They prefer representation from both on the committee 
with a definite bias towards secondary schools of comparable size. 

2 

op. cit, p. 12. 

o 35 

ERLC 
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TABLE XXV 
(N=83) 



The Effectiveness in Terms of Evaluation of 
the Selection and Composition of the Visiting 
Conmittee in NCA Evaluations as reported by 
Administrators and Teachers 





Visiting Committee 
Selection & Composition 




E 

t? 


!ffecti\ 
irms of 


/eness in 
Evaluatic 


)n 


Use ( 
Proce 


)f 

lure 




C a1 an^^ on 
o6 1 6C t 1 un 


Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N 


% 


No 

N % 


1. 


By steering committee 


5 


6 


7 8 


26 


31 


31 


37 


49 


59 


25 


30 


2. 


By administration 


7 


8 


4 5 


29 


35 


18 22. 


43 


52 


31 


37 


3. 


By both of the above 


2 


2 


1 1 


21 


25 


40 48 


45 


54 


30 


36 


4. 


By both with NCA and visiting 
chairperson approval 


5 


6 


7 O 


18 


22 


33 40 


46 


55 


29 


35 


5. 


By NCA and visiting chair- 
person only 

Composition 


26 


31 


8 10 


6 


7 


2 


2 


5 


6 


65 


78 


6. 


Specialists in area of 
evaluation 


0 


0 


4 5 


16 


19 


58 


70 


77 


93 


3 


4 


7. 


General ists 


6 


7 


8 10 


32 


39 


21 


25 


57 


59 


16 


19 


8. 


From secondary schools only 


8 


10 


9 11 


18 


22 


12 


15 


17 


21 


55 


66 


9. 


From colleges only 


22 


27 


10 12 


9 


11 


2 


2 


5 


6 


65 


78 


10. 


From both of the above 


1 


1 


4 5 


16 


19 


50 


60 


69 


83 


9 


n 


11. 


From comparable size schools 


0 


0 


7 8 


17 


21 


47 


57 


69 


83 


6 


7 


12. 


From larger schools 


4 


5 


17 21 


32 


39 


11 


13 


55 


66 


16 


19 



ERIC 



36 



34 



TABLE XXVI 
(N=8) 

The Effectiveness in Terms of Evaluation of 
the Selection and Composition of the Visiting 
Conmittee in NCA Evaluations as reported by 
Administrators and Teachers in Schools below 
200 enrollment. 



Visiting Committee 
Selection & Composition 



Selection 

1. By steering committee 

2. By admins tration 

3. By both of the above 

4. By both with NCA and visiting 
chairperson approval 

5. By NCA and visiting chairperson 
only 

Composition 

6. Specialists in area of evalua- 
tion 

7. General is ts 

8. From secondary schools only 

9. From colleges only 

10. From both of the above 

n. From comparable size schools 

12. From larger schools 



ERIC 



Effectiveness in 
terms of Evaluation 



Least 

N % 



0 0 
0 0 
0 0 

0 0 

5 63 



0 0 

0 0 

2 25 

3 38 

1 13 
0 0 
0 0 



Some 
N % 



1 13 

0 0 

0 0 

1 13 
0 0 



0 
2 
2 
2 
0 
2 



0 
25 
25 
25 

0 

25 
38 



Moderate 
N % 



63 
63 
2 25 



2 25 
1 13 



3 
2 
0 
0 



38 
25 
• 0 



0 
0 
0 

1 13 



Most 
N % 



2 
3 
6 

5 



25 
38 
75 

63 

0 



50 
38 
1 13 
0 0 
6 75 
5 63 
3 38 



Use of 
Procedure 



Tes 
N % 



7 88 

7 88 

8 100 

7 88 

0 0 

7 88 

7 88 

1 13 
0 0 

6 75 

7 88 
7 88 



No 
N 



1 13 
1 13 

0 0 

1 13 
8 lOO 

0. 0' 

0 0 

5 63 

6 75 

1 13 
0 0 
0 0 
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TABLE XXVII 
(N=23) 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of the 
Visiting Committee in NCA Evaluation as 
reported by Administrators and Teachers 
is Schools between 300 and 600 enrollment 



Visiting Comrtiittee 
Selection & Composition 



Effectiveness in 
terms of Evaluation 


Use of 
Procedure 


Least 

N % 


Some 
N % 


Moderate 

N % 


Most 
N % 


Yes 
N % 


No 

M % 


0 


2 9 


5 22 


9 39 


13 51 


8 35 


1 4 
1 t 


n 
u 




7 Q 


7 


If 01 


n 
u 


n 
u 








1 9 C9 
1 £ 3£ 


1 4 


1 4 


4 17 


7 30 


10 44 


12 52 


A 17 
H 1 / 


u 


U 


U 


U 




0 


0 


6 26 


14 61 


21 91 


2 • 9 


0 


0 


10 44 


6 26 


18 78 


2 9 


2 9 


0 


3 14 


3 14 


3 14 


17 74 


5 22 


0 


1 4 


1 4 


0 


19 82 


0 


0 


4 17 


13 57 


21 91 


1 4 


0 


0 


5 22 


13 57 


19 83 


3 14 


1 4 


1 4 


9 39 


4 17 


17 74 


4 17 



Selection 

1. By steering committees 

2. By administration 

3. By both of the above 

4. By both with NCA and 
visiting chairperson 

5. By MCA and visiting 
chairperson only 

Composition 

1. Specialists in area of 
evaluation 

2. General is ts 

3. From secondary schools only 

4. From colleges only 

5. From both of the above 

6. From comparable size schools 

7. From larger schools 



ERIC 



38 



TABLE XXVIII 
(N=21) 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of the 
Visiting Committee in NCA Evaluation as 
reported by Administrators and Teachers 
in Schools between 750 and 1000 enrollment 



Visiting Coirmittee 
Selection & Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procediirp 




Selection 


Least 

N % 


Soma 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1. 


By steering committee 


3 


14 


4 19 


6 29 


6 29 


8 3i 


n 


52 


2. 


By administration 


1 




1 5 


8 38 


7 33 


15 71 


5 


24 


3. 


By both of the above 


1 




1 5 


J •to 




11 CI 

1 1 52 


8 


32 


4. 


By both with NCA and 
visiting chairperson 
approval 


1 


5 


2 10 


7 3^^ 




1 A /ID 


7 


33 


5. 


By NCA and visiting chair- 
person only 

Composition 


5 


24 


4 19 


4 19 


0 


1 5 


15 

• 


71 


6. 


Sepecialists in area of 
evaluation 




0 


1 5 


1 5 


19 91 


20 95 




0 


7. 


General is ts 


4 


19 


0 


7 33 


5 24 


12 57 


6 


29 


8. 


From secondary schools only 


2 


10 


2 10 


7 33 


4 19 


" 5 24 


13 


62 


9. 


From colleges only 


8 


38 


3 14 


3 14 


0 


0 


17 


81 


10. 


From both of the above 




0 


3 14 


4 19 


12 57 


17 81 


3 


14 


n. 


From comparable size schools 




0 


•• 2 10 


3 14 


14 67 


17 81 


2 


10 


12. 


From laraer schools 

1 1 will ■ Ul ^^1 aJWllW ■ 


2 


10 


4, 19 

0 


10 48 

J9 


3 14 
o 1 *t 


15 71 


1 ^ 


IQ 
1 V 



TABLE XXIX 
(N=18) 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of the 
Visiting Committee in NCA Evaluations as 
reported by Administrators and teachers 
in Schools between 1500 and 2000 enrollment 



Visiting Committee 
Selection & Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




OC 1 Cl^ t lun 


Least 

N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 

N % 


1. 


By steering committee 


2 11 


0 


4 22 


8 44 


13 


72 


2 


11 


2. 


By administration 


2 11 


1 6 


9 50 


2 11 


10 


56 


4 


22 


3. 


By both of the above 


1 6 


0 


3 17 


12 67 


13 


72 


4 


22 


4. 


By both with NCA and 


^ 17 
«3 1 / 


1 0 


3 17 


8 44 


12 


67 


6 


33 


5. 


Bv NCA ^nd \/i<;itinr rh;)ir- 

person only 
Composition 


6 33 


1 6 


1 6 


1 6 


4 


22 


12 


67 


6. 


Specialists in area of 
evaluation 


0 


2 11 


5 28 


11 ol 


17 


94 


1 


6 


7. 


General ists 


2 11 


5 28 


7 39 


2 n 


13 


72 


5 


28 


8. 


From secondary schools only 


1 6 


2 11 


7 39 


C 


4 


22 


13 


72 


9. 


From colleges only 


1 6 


4 22 


3 17 


0 


3 


17 


14 


78 


10. 


From both of the above 


0 


0 


6 33 


10 56 


16 


89 


1 


6 


11. 


From comparable size schools 


0 


2 11 


7 39 


8 44 


15 


S3 


1 


6 


12. 


From larger schools 


0 


6 33 


7 39 


1 6 


12 


67 


3 


17 
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TABLE XXX 
(N=13) 

The Effectiveness in Terms of Evaluation of 
the Selection and Composition of the Visiting 
Comnittee in NCA Evaluations as reported by 
Administrators and Teachers in Schools over 
2000 enrollment. 



Visiting Committee 
Selection & Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Selection 


Least 

N % 


Some 
N % 


iloderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1 . 


By steering comiiTttee 


0 


0 


0 0 


6 46 


6 


46 


8 


62 


3 


23 


2. 


By administration 


3 


23 


2 15 


3 23 


4 


31 


4 


31 


7 


54 


3. 


By both of the above 


0 


0 


0 0 


4 31 


6 


46 


4 


31 


6 


46 


4. 


By both with NCA and visiting 
chairperson approval 


0 


0 


2 15 


2 15 


7 


54 


7 


54 


3 


23 


5. 


By NCA and visiting chairperson 
only 

- 

Composition 


6 


46 


3 23 


0 0 


1 


a 


0 


0 


9 


69 


6. 


Specialists in area of eval- 
uation 


0 


0 


1 8 


1 8 


10 


54 


12 


92 


u 


0 


7. 


General is ts 


0 


0 


1 8 


6 46 


■ 5 


39 


7 


54 


3 


23 


8. 


From secondary schools only 


1 


8 


3 23 


1 8 


4 


31 


4 


31 


7 


54 


9. 


From colleges only 


5 


3^ 


1 8 


2 15 


1 


8 


2 


15 


9 


69 


10, 


From both of the above 


0 


0 


1 8 


2 15 


9 


69 


9 


6i 


3 


23 


11. 


From comparable size schools 


0 


0 


1 8 


2 15 


7 


54 


11 


BE 


0 


0 


12. 


From larger schools 


1 


8 


3 23 

4= 


5 39 


0 


0 


4 


3 


5 


39 
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The Effectiveness in Terms of Evaluation 
of the Selection and Composition of the 
Visiting Committee in NCA Evaluations as 
reported by Administrators 



Visiting Committee 
Selection & Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Selection 
By steering committee 


Least 

N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
M % 


No 

N % 


1. 


1 5 


3 14 


5 


24 


10 


48 


14 


67 


6 


29 


2. 


By administration 


1 5 


0 


10 


48 


5 


24 


14 


67 


5 


24 


3. 


By both of the above 


1 5 


0 


5 


24 


11 


52 


13 


62 




29 


4. 


By both with NCA and visiting 
chairperson approval 


3 14 


3 14 


3 


14 


10 


48 


14 


67 


7 


33 


5. 


By NCA and visiting chairpersoi 
only 

Composition 


1 

8 38 


■ 

2 10 


1 


5 




0 


2 


10 


16 


76 


6. 


Specialists in area of 
evaluation 


0 


3 14 


6 


29 


11 


52 


20 


95 




0 


7 
t 


General ists 


1 5 


5 24 


7 


33 


5 


24 


17 


81 


2 


10 


8. 


From secondary schools only 


3 14 


3 14 


3 


14 


2 


10 


5 


24 


11 


52 


9. 


From colleges only 


5 24 


2 10 


3 


14 




0 


2 


10 


14 


67 


10. 


From both of the above 


1 5 


0 


6 


29 


12 


57 


18 


86 


2 


10 


11. 


From comparable size schools 


0 


3 14 


8 


38 


8 


38 


18 


86 




0 


12. 


From larger schools 


0 


10 48 

4Z 


5 


24 


1 


5 


15 


71 


3 


14 
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The Effectiveness in Terms of Evaluation 
of the Sel'iction and Composition of the 
Visiting Committee in NCA Evaluations 
as Reported by Teachers. 



Visiting Committee 
Selection and Composition 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 




Selection 


Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 


% 


1. 


By steering committee 


4 


7 


4 7 


21 34 


21 


34 


35 


57 


19 


31 


2. 


By administration 


6 


10 


4 7 


19 31 


13 


21 


29 


47 


26 


42 


3. 


By both of the above 


1 


2 


1 2 


16 26 


29 


47 


32 


52 


24 


39 


4. 


By both with NCA and visiting 
chairperson approval 


2 


3 


4 7 


15 24 


23 


37 


32 


52 


22 


36 


5. 


By NCA and visiting chair- 
person only 

P /\nrm/\ C n ^ 1 A n 

uOniposi tion 


18 


29 


6 10 


5 8 


2 


3 


3 


5 


49 


79 


6. 


Specialists in area of 
evaluatson 


0 


0 


1 2 


10 16 


47 


76 


57 


92 


3 


5 


7. 


General ists 


5 


8 


3 5 


25 40 


16 


26 


40 


65 


14 


23 


8. 


From secondary schools only 


5 


8 


6 10 


15 24 


10 


16 


12 


19 


44 


71 


9. 


From colleges only 


17 


27 


8 13 


6 10 


2 


3 


3 


5 


51 


82 


10. 


From both of the above 


0 


0 


4 7 


10 16 


38 


61 


51 


82 


7 


11 


n. 


From comparable size schools 


0 


0 


4 7 


9 15 


39 


63 


51 


82 


6 


10 


12. 


From larger schools 


4 


7 


7 11 

43 


27 44 


10 


16 


40 


65 


13 


21 
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The desireability of sharing in the selection process itself is also evident 
since they expressed a clear mandate for not leaving this responsibility 
solely to the NCA and the visiting chairman. 

Tables XXVI, XXVII, XXVIII, XXIX, and XXX indicate no great difference 
in opinion and use by size of school; nor is there any general disagreement 
between administrators and teachers on tables XXXI and XXXII. 

Activities of Visiting Comnittee 

A visiting committee engages in a variety of activities as it gathers 
and analyzes data for the purpose of evaluation. However, there are 
several basic modes of behavior which are more effective than others in 
performing this task. Therefore, one of the purposes of this survey was to 
identify those activities which were regarded as effective and to 
determine the extent of their use. 

Table XXXIII indicates high frequency of use of the following procedures 
on the part of the visiting committee: an initial informal get-acquainted 
meeting, orientation by visiting committee, classroom visits by evaluators, 
discussions with students by evaluators, checking criteria forms filled 
out by faculty, final oral report to administration and board, final 
written report to administration and board, final written report to faculty, 
soliciting community opinion on the educational program, and continued 
contact with the faculty. Of these, classroom visits by evaluators was used 
most frequently and was judged as most effective in terms of evaluation. 

final written report to the administration and board was next, followed 
by an orientation by the visiting committee, an initial informal get- 
acquainted meeting, checking criteria forms, continued contact with 
faculty, final written report to faculty, and final oral report to the 
administration and board. Of those most frequently used, the activity 

o 44 
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of soliciting community opinion on educational programs was identified as 
least effective in terms of evaluation as was a final oral report to the 
faculty which was an infrequently used activity. While these latter two 
activities had the most spread in response on balance they were regarded 
as effective procedures by the respondents since a majority in each case saw 
them as moderate or most effective in terms of evaluation. 

Tables XXIV, XXV, XXVI, XXXVII, and XXXVIII indicate that size of 
school was not a significant factor in the evaluation of the effectiveness 
and use of the activities of the visiting committee. A comparison of 
administrator and teacher responses on tables XXXIX and XL reveals, however, 
that teachers tended to perceive a final oral report to the faculty as 
more effective than did administrators. There was general agreement on the 
other activities, however. 
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TABLE XXXIII 
{N=83) 

The Effectiveness in terms of Evaluation of 
Selected Activities of the Visiting Committee 
in NCA Evaluations as reported by Admini- 
strators and Teachers. 



Activities of Visiting Committees 



Effectiveness in 



terms of 



Evaluation 



1. Initial Informal get- 
acquainted meeting 

2. Orientation by visiting 
commi ttee 

3. Classroom visits by evaluators 

4. Discussions with students 
by evaluators 

5. Continued contact with 
facul ty 

6. Checking Criteria ^'orms 
filled out by faculty 

7. Soliciting community 
opinion on educational 
program 

8. Final oral report to 
facul ty 

9. Final oral report to 
administration and 

10. Final written report 
to faculty 

11. Final written report to 
administration and 
board 



Least 
N % 



0 0 

0 0 

1 1 

2 2 
1 1 
0 0 

0 0 

5 6 

0 0 

1 1 

0 0 



Some 
N % 



oderate 
N % 



6 7 

3 4 

1 1 

3 4 
6 7 

4 5 

10 12 
9 11 

2 2 

5 6 

4 5 



21 25 

18 22 
16 19 

26 31 
16 19 

27 33 

32 39 

19 23 

28 34 
18 22 

14 17 



Most 
N % 



52 62 

53 64 
61 74 

44 53 

47 57 

47 57 

27 33 
24 28 
43 52 
46 55 

56 68 



Use of 
Procedure 



Yes 
N % 



78 94 

72 87 
76 92 

76 92 

62 75 

79 95 

66 80 
27 33 
71 86 

67 81 

76 92 



No 

N %> 



2 2 

5 6 

3 4 

2 2 
15 18 
1 1 

13 16 
50 60 
5 6 
10 12 

3 4 



ERIC 



46 



TABLE XXXIV 
(N=8) 

The Effectiveness in Terms of Evaluation 
of Selected Activities of the Visiting 
Committee in NCA Evaluations as reported by 
Administrators and Teachers in Schools 
below 200 enrollment. 
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Activities of Visiting Committees 



1. Initial informal get-acquainted 
meeting 

2. Orientation by visiting 
commi ttee 

3. Classroomi visits by evaluators 

4. Discussions with students by 
evaluators 

5. Continued contact with faculty 

6. Checking Criteria forms filled 
out by faculty 

7. Soliciting community opinion 
on educational program 

8. Final oral report to faculty 

9. Final oral report to adminis- 
tration and board 

10. Final written report to faculty 

11. Final written report to ad- 
ministration and board 



Effectiveness in 
terms of Evaluation 



Least 
N % 



0 0 
0 0 
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0 
0 

0 
0 



0 
0 

0 
0 



0 0 

1 13 
0 0 

0 0 

0 0 



Some 
N % 



0 
0 

0 

0 



0 
0 

0 
0 



1 13 

0 0 

3 38 

2 25 

1 13 

0 0 

0 0 



Moderate 
N % 



3 38 

3 38 

1 13 

3 38 

1 13 

4 50 

2 25 

2 "25 

2 25 

2 25 

1 13 
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Most 
N % 



4 50 

4 50 

6 75 

4 50 

4 50 

3 38 

2 25 

2 25 

4 50 

5 63 

6 75 



Use of 
Procedure 



N % 



7 88 

7 88 

7 88 

7 88 

5 63 
7 88 

6 75 

5 63 

7 88 

7 88 

7 88 



No 

N % 



0 0 

0 0 

0 0 

0 0 

2 25 

0 0 

1 13 

2 25 
0 0 

0 0 

0 0 



TABLE XXXV 
(N=23) 



The Effectiveness in Terms of Evaluation 
of Selected Activities of the Visiting 
Committee in NCA Evaluations as reported 
by Administrators and Teachers in Schools 
Between 300 and 600 enrollment 



Activities of Visiting 
Conmittees 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 






Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


NO 
M 


% 


1. 


Initial informal get- 
aquainted meeting 


0 


0 


4 


17 


17 


74 


21 91 


1 


4 


2. 


Orientation by visiting 
commi ttee 


0 


0 


3 


14 


17 


74 


20 87 


2 


9 


3. 


Classroom visits by 
evaluators 


0 


0 


2 


9 


19 


83 


21 91 


1 


4 


4. 


Discussions with students 
by evaluators 


1 4 


1 4 


10 


44 


8 


35 


20 87 


2 


9 


b. 


Continued contact with 
f acul ty 


0 


2 9 


8 


35 


9 


39 


18 78 


4 • 


17 


6. 


Checking Criteria forms 
filled out by faculty 


0 


1 4 


5 


22 


15 


65 


21 91 


1 


4 


7. 


Soliciting community 
opinion on educational 
program 


0 


2 9 


10 


44 


7 


30 


18 78 


4 


17 


8. 


Final oral report to 
faculty 


0 


0 


5 


22 


5 


22 


5 22 


17 


74 


9. 


Final oral report to 
administration and board 


0 


0 


8 


35 


12 


52 


20 87 


2 


9 


10. 


Final written report to 
faculty 


0 


0 


4 


17 


15 


65 


19 83 


2 


9 


n. 


Final written report to 
administration and board 


0 


0 


4 


17 


16 


70 

1 


20 87 


1 


4 
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TABLE XXXVI 
(N=21 ) 

The Effectiveness in Terms of Evaluation 
of Selected Activities of the Visiting 
Committee in NCA Evaluations as reported 
by Administrators and Teachers in Schools 
between 750 and 1000 enrollment 
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Activities of Visiting Committees 



1. Initail informal get- 
acquainted meeting 

2. Orientation by visiting 
commi ttee 

3. Classroom visits by evaluators 

4. Discussions with students by 
evaluators 

5. Continued contact with 
f acul ty 

6. Checking Criteria forms 
filled out by faculty 

7. Soliciting community opinion 
on educational program 

8. Final oral report to faculty 

9. Final oral report to 
administration and board 

10. Final written report to 
faculty 

11. Final written report to 
administration and board 



lERlC 



Effectiveness in 
terms of Evaluation 



Least 
N % 



0 

1 5 



1 5 



0 

1 5 



1 5 



Some 

. N % 



3 14 

1 5 
0 

1 5 

3 14 

1 5 

2 10 

3 14 



Moderate 
N % 



3 14 

6 29 

8 38 

9 43 

5 24 

9 43 

9 43 

9 43 

12 57 

4 19 
4 19 



Most 
N % 



15 71 

13 62 

12 57 

9 43 

11 52 

10 48 



6 29 

J 

4 19 



8 38 
13 62 
15 71 



Use of 
Procedure 



Yes 
N % 



20 95 

19 91 

17 81 

19 91 

16 76 

20 95 

15 71 

7 33 

18 86 

17 81 
20 95 
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No 

N % 



1 5 

2 10 

0 

4 19 

0 

4 19 
12 57 

3 14 
3 14 

0 



TABLE XXXVII 
(N=18) 
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The Effectiveness in Terms of Evaluation 
of Selected Activities of the Visiting 
Committee in NCA Evaluations as reported 
by Administrators and teachers in Schools 
between 1500 and 2000 enrollment 



Activities of Visiting Committees 



1. Initial informal get- 
acquainted meeting 

2. Orientation by visiting 
committee 

3. Classroom visits by evaluators 

4. Discussions with students by 
evaluators 

5. Continued contact with 
faculty 

6. Checking Criteria forms 
filled out by faculty 

7. Soliciting community opinion 
on educational program 

8. Final oral report to faculty 
9. 



10. 



Final oral report to adminis- 
tration and board 

Final written report to 
faculty 



n. Final written report to 
administration and board 



ERIC 



Effectiveness in 
terms of Evaluation 



Least 

N % 



0 
0 



0 

3 17 



Some 
N % 



3 17 

0 
0 



2 11 

3 17 

3 17 

1 6 

5 28 

4 22 



Moderate 
N % 



7 39 

1 6 

5 28 

3 17 
1 6 
5 28 

5 28 

1 6 

4 22 
4 2?. 

2 n 



50 



Most 
N % 



7 39 

13 72 
12 67 

14 78 
12 67 
10 56 

7 39 
5 28 

10 56 

8 44 

11 61 



Use of 
Procedu 



re 



Yes 
N % 



17 94 

15 83 

18 100 

18 100 
12 67 
18 100 

15 83 
5 28 

16 89 
16 89 
18 100 



No 

N % 



1 6 

0 
0 

0 

3 17 
0 

3 17 
13 72 

0 

1 6 
0 
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TABLE XXXVIII 
{N=13) 

The Effectiveness in Terms of Evaluation of 
Selected Activities of the Visiting Committee 
in NCA Evaluations as reported by Administrators 
and Teachers in Schools over 2000 enrollment. 



Activities of Visiting Committees 



1. Initial informal get-acquainted 
meeting 



2. Orientation by visiting commi 

3. Classroom visits by evaluators 

4. Discussions with students by 
eval uators 

5. Continued contact with faculty 

6. Checking Criteria forms filled 
out by faculty 

7. Soliciting community opinion 
on educational program 

8. Final oral report to faculty 

9. Final oral report to adminis- 
tration and board 

10. Final written report to 
f acul ty 

11. Final written report to 
administration and board 



0 0 
ttJeeO 0 
0 0 



Effectiveness in 
terms of Evaluation 



Least 

N % 



1 8 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 

0 0 
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Some 
N % 



0 0 
2 15 

1 8 

1 8 

0 0 

0 0 

0 0 

1 8 

0 0 

0 0 

0 0 
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Moderate 
N % 



4 31 

5 39 

0 0 

1 8 

1 8 

4 31 

6 46 

2 15 

2 15 
4 31 

3 23 



"Most 
N % 



9 69 

6 46 

12 92 

9 69 

11 85 

9 69 

5 39 

8 62 

9 69 
5 39 
8 62 



Use of 
Procedure 



N % 



13 100 

11 85 
13 100 

12 92 

11 85 

13 100 

12 92 
5 39 



10 
8 

11 8 



77 



62 



TABLE XXXIX 
(N=21) 



49 



The Effectiveness in Terms of Evaluation 
of Selected Activities of the Visiting 
Committee in NCA Evaluations as reported 
by Administrators 



Activities of Visiting Committees 


Effectiveness in 
terms of Evaluation 


1 Use of 

Procedure 






Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


1 Yes 
1 N % 


No 

N % 


1. 


Initial informal get- 
»:cquainted meeting 


0 


3 14 


6 


29 


11 


52 


19 91 


1 5 


. 2. 


Orientation by visiting 
committee 


0 


1 5 


4 


19 


15 


71 


20 95 


0 


* 0 . 


Classroom visits by evaluators 


0 


0 


4 


19 


. 16 


76 


20 95 


0 


4. 


Discussions with students by 
evaluators 


0 


1 5 


8 


38 


11 


52 


20 95 


0 


5. 


Continued contact with 
faculty 


0 


2 10 


7 


33 


10 


48 


17 81 


2 10 


6. 


Checking Criteria forms filled 
out by faculty 


0 


3 14 


9 


43 


8 


38 


20 95 


0 


7. 


Soliciting community opinion 
on educational program 


0 


5 24 


7 


33 


5 


24 


16 76 


2 10 


8. 


Final oral report to faculty 


4 19 


3 14 


4 


19 


4 


19 


I 7 33 


11 52 


9. 


Final oral report to 
administration and board 


0 


1 5 


5 


24 


14 


67 


20 95 


0 


10. 


Final written report to i 
faculty 


0 


4 19 


5 




a 
o 


JO 1 


15 71 


3 14 


n. 


Final written report to 
administration and board 


0 


3 14 


1 


5 


16 


76 


20 95 


0 
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TABLE XL 
{N=62) 



The Effectiveness in Terms of Evaluation of 
Selected Activities of the Visiting Committee 
in NCA Evaluations as Reported by Teachers. 



Activities of Visitinq Committees 


Effectiveness in 
terms of Evaluation 


Use of 
Procedure 






Least 
N % 


Some 
N % 


Moderate 
N % 


Most 
N % 


Yes 
N % 


No 
N 




1. 


Initial informal get- 
acquainted meeting 


0 


0 


3 


5 


15 


24 


41 


66 


59 95 


1 ■ 


2 


2. 


Orientation by visiting 
commi ttee 


0 


0 


2 


3 


14 


•23 


38 


61 


52 84 


5 


a 


3. 


Classroom visits by 
evaluators 


1 


2 


1 


2 


12 


19 


45 


73 


56 90 


3 


5 


4. 


Discussions with students 
by evaluators 


2 


3 


2 


3 


18 


29 


33 


53 


56 90 


2 


3 


5. 


Continued contact with faculty 


1 


2 


4 


7 


9 


15 


37 


60 


45 73 


13 


21 


6. 


Checking Criteria forms 
filled out by faculty 


0 


0 


1 


2 


18 


29 


39 


63 


59 95 


1 


2 


7. 


Soliciting community opinion 
on educational program 


0 


0 


5 


8 


25 


40 


22 


36 


50 81 


n 


18 


8. 


Final oral report to 
administration and board 


0 


0 


1 


2 


23 


37 


29 


47 


51 n 


5 


8 


9. 


Final written report to 
faculty 


1 


2 


1 


2 


13 


21 


38 


61 


52 84 


7 


n 


10. 


Final written report to 
administration and board 


U 


U 


1 


o 

L 


1 0 






65 

! 


56 9C 


3 


5 
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PART III 

Summary of Results 

Within the purview of this survey and in terms of the variables 
which were investigated it would appear that the following procedures and 
activities would lend themselves to the most effective evaluation. 

The Self Study 

!• The steering committee should be selected by the administration and 

chaired Dy a person similarly selected. It should be composed of experienced 
faculty with representation insofar as possible from each department 
or subject area. 

2. The work committees should be selected by the steering committee and they 
should be constituted to reflect interdepartmental or interdisciplinary 
membership. There should be total faculty participation on at least 

one committee and, where possible, committees should be larger than three. 

3. The activities of the self study committees should be concentrated 

on gatherinq and analyzing data so that they can identify strengths and 
weaknesses and make recommendations for change. To accomplish 
these tasks the committees should make individuals responsible for completing 
certain sections of the Evaluative Criteria, modifying it to meet the 
needs of the school, and sharing this data within their respective department 
or subject areas. Feedback should be sought through general discussion 
on all sections of the Criteria. Size of school is a factor in 
determining to what extent data should be shared and discussed by the 
total faculty. 
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The Visitation 

1. The visiting committee should be chosen by the steering committee and 
administration with the approval of the visiting chairperson and the 
NCA. 

2. The composition of the visiting committee should emphasize expertise 
(i.e. specialists) in the area in which they are evaluating. The members 
should be chosen from both the college and secondary school ranks 

with emphasis on comparable size schools in the latter case. 

3. \: visiting committee should conduct an informal get-acquainted 

. meeting and an orientation for the faculty before actually beginning 
their evaluation. 

4. The visiting committee should use the Evaluative Criteria forms filled 
out by the faculty in their evaluation and they should make classroom 
visits and maintain contact with the faculty throughout the 
visitation. They should also engage in discussions with students. 

5. Before they leave the visiting committee should make a final oral 
report to the administration and the board. The final written report 
should be sent to the administration and the boa.d and be made 
available to the faculty. 

Another aspect of this study was to visit the administrators of schools 
which had undergone a recent evaluation to secure additional information 
concerning the effectiveness of the procedures and activities in NCA 
evaluations. This was accomplished by talking with twelve administrators 
in nine schools of various sizes within NCA Districts 6 and 7. Most of 
these administrators had, of course, previously returned a questionnaire and 
their responses are a part of the complete report. There were many 
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excellent suggestions since many had either served as a chairman of a 
visiting committee on an NCA evaluation or as a visiting committee 
member. Their general comments are related as follows: 

Generally they gave high marks to the evaluative process engaged in under 
the auspices of the NCA. Its scope and depth seemed to them to be the 
best conceptualized and best organized of any now presently in use. 

Their suggestions for improvement, therefore, were related 
primarily to improving the model in its existing form so as to make it 
more effective for improving the educational programs of the schools. 
More specifically they felt the need for improving coordination with 
other evaluative agencies particularly when several were in the school at 
same time. The question of the responsibility of evaluation in the over- 
lapping areas of vocational education was cited as paramount by several. 

Another suggestion which secured favorable consensus as a possible 
improvement was the identification through the administrators of NCA 
schools of superior teachers in each area of evaluative concern to comprise 
a master list from which schools undergoing evaluation could select their 
visiting committees. This was regarded as an effective way for spreading 
quality instructional ideas among NCA schools. 

A very creditable idea related to the use of recommendations 
made by the self study and visiting committees in the follow up phase 
of evaluation was also suggested. It called for the establishment of 
a priority commiitee consisting of administration, faculty and students 
whose task it would be to take the various recommendations, rank them 
according to need and feasibility, and submit them to the superintendent 
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and the board for their support. This was believed to be a method by which 
action could be enhanced and, thus, make the evaluation more useful. 

A Final Comment 

It would be presumptuous to conclude that on the basis of the 
procedures and activities identified in this survey that a particular school 
would enjoy an t Bctive evaluation - one that portends maximum quality 
in the direction it giveSto that school. Indeed, the above should be regarded 
as miniir^2l activity on the part of the self study and visiting conmittees 
if an effective evaluation is to occur. Much more, of course, is 
involved. In addition, the roles of the visiting chairperson and the 
principal are vital, and certainly most crucial is the general attitude 
that the school has towards the purpose of evaluation. The climate of the 
school must be one in which strengths are regarded as opportunities and ;i 
weaknesses as challenges if the school is to get the most out of its evaluative 
efforts. It is clear, however, that if the desire is there the 
system is flexible enough to make it happen. 

Finally, this investigator wishes to express his gratitude to the 
administrators and the faculties of the schools who participated in this 
study. The time and effort that each spent on filling out the survey form 
answering my questions is indicative of their desire to engage in dialogue 
on the improvement of education. 
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SURVEY OF SELF STUDY AND VISITING COMMITTEE PROCEDURES IN NCA EVALUATIONS 



Name 



ERIC 



Position^ 
School 



Self Study Procedures 



Selection & Composition of Self 
Study Committees (please answer 
each Item) 



Steering Committee 

1. Selected by faculty 

2. Selected from volunteers 
from faculty 

3. Selected by administration 

4. Selected from a pool of elect- 
ed faculty by administration 

5. Departments heads only 

6. Representation from each de- 
partment or subject area 

7. Less than one from each de- 
partment or subject area 

8. Experienced faculty only 

9. Chairperson selected by 
faculty 

10. Chairperson selected by 
steering committee 

;.l. Chairperson selected by 
' administrator 

12. Chairperson an administrator 

Other (list and check) 

1. 

2. 

Work Committees 

1. Selected by faculty in each 
department 

2. Volunteers 



Effectiveness in terms of 
Evaluation (check each item) 



Least 



some 



moderate 



38 



most 
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Selection & Composition of Self Study 
Committees (please answer each item) 


Effectiveness in terms of 
Evaluation (check each item) 


Was Procedure 
used in your 
evaluation? 


Work Committees (Cont.) 


Least 


some 


moderate 


most 


Yes 


No 


3. Selected by steering committee 

4. Selected by administration 

5. Selected by department 
chairperson 

6. Experienced faculty only 

7. Interdepartmental or interdis- 
ciplinary membership 

8. Membership solely from depart- 
ment or subject area 

9. Total faculty participation on 
at least one committee 

10. Faculty participation on more 
than two committees 

11. Conuittee size equal to or less 
than three 

12. Committee size greater than three 
Other (list and check) 

1. 
2. 

Activities of Self Study Committees 

1. Gathering and analyzing data 

2. Sharing data in total faculty 
meetings 

3. Sharing data through written re- 
ports to t ^tal faculty 

4. Seeking feedback of total 
faculty in faculty meetings 

5. Sharing data and seeking feed- 
back within respective depart- 
ments or subject areas 

6. Individuals responsible for com- 
pleting certain sections of 
Evaluative Criteria 
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Selection & Cor^ositlon of Self Study 
Committees (please answer each item) 



Activities of Self Study Conmittees 
( ContT l 

7. General discussion within depart- 
ments or areas on all sections 

of the Criteria 

8. Using outside consultants in 
self study 

9. Modifying Criteria to needs of 
school 

10. Involving board members in self 
study 

11. Involving cotmnunity members in 
self study 

12. Summarizing & identifying 
strengths, weaknesses with rec- 
omnendations for change. 

Other (list and check) 

1. 

2. 



Least 



Effectiveness in terms of 
Evaluation (check each item) 



some 



moderate 



most 



Visiting Commf ttee ProceduTes 



Was Procedure 
used in your 
evaluation? 
No 



Yes No 



Selection & Composition of Visiting 
Committee (please answer each item) 


Effectiveness in terms 
Evaluation (check each 


of 

item) 


Was Procedure 
u8ed in your 

evaluation? 


Selection 


Least 


some 


moderate 


most 


Yes 


No 


1. By steering committee 














2. By administration 














3. By both of the above 














4. By both with NCA and visiting 
chairperson approval 














5. By NCA and visiting chairperson 
only 














Other (list and check) 
k. 














2. 
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Selection & Composition of Visiting 
Comittee (please answer each item) 



ERIC 



Composition 
!• Specialists in area of evaluation 

2. Gene rail sts 

3» From secondary schools only 

4. From colleges only 

5. From both of the above 

6. From comparable size schools 
1 . From larger schools 

Other (list and check) 
1. 
Z. 

Activities of Visiting Committees 

1. Initial informal get^acquainted 
meeting 

!• Orientation by visiting committee 

3. Classroom visits by evaluators 

4* Discussions with students by 
evaluators 

5# Continued contact with faculty 

6. Checking Criteria forms filled 
out by faculty 

7. Soliciting coninunity opinion on 
educational program 

8. Final oral report to faculty 

9. Final oral report to adminis- 
tration and board 

10. Final written report to faculty 

11. Final written report to adminis- 
tration and board 

Other (list and check) 

1. 

2. 

THANK YOU FOR YOUR CONTRIBUTION: 



Effectiveness in terms of 
Evaluation (check each item) 



Least some moderate most 



PLljg5|E' RETURN IT TO YOUR PRINCIPAL 



Was Procedure 
used in your 
evaluation? 



Yes No 



